AD-A157  142 


UNCLASSIFIED 


FEASIBILITV  OF  AN  AMC  (ARMY  MATERIEL  COMMAND) 
CONTRACTOR  PERFORMANCE  HISTORV  SVSTEM(U)  ARMV 
PROCUREMENT  RESEARCH  OFFICE  FORT  LEE  VA  A  J  HANDLER 
MAV  85  APRO-83-09  F/G  15/5 


■ 

sir 

■ 

END 

■ 

APRO  83-09 
FINAL 


FEASIBILITY  OF  AN  AMC 
CONTRACTOR  PERFORMANCE  HISTORY  SYSTEM 


_Aoo«silon  for 
OTIS  Qfu kl 

otic  m 

Unannounced  Q 
Justification _ 


Arthur  J.  Mandler 


_ 

Distribution/ 
Availability  Codas 
.  (Avail  ond/«jp 
W|t  Spooial  ” 


The  pronouns  "he,"  “his,"  and  "him,"  when  used  In  this  publications,  represent 
both  the  masculine  and  feminine  genders  unless  otherwise  specifically  stated. 

Information  and  data  contained  In  this  document  are  based  on  Input  available  at 
time  of  preparation.  Because  the  results  may  be  subject  to  change,  this  document 
should  not  be  construed  to  represent  the  official  position  of  the  US  Army. 


Approved  for  Public  Release;  Distribution  Unlimited 

US  Army  Procurement  Research  Office 
Office  of  the  Deputy  Chief  of  Staff  for  Logistics 
Fort  Lee,  Virginia  23801-6045 


1 


EXECUTIVE  SUMMARY 


A.  PROBLEM.  Within  the  field  of  defense  acquisition  it  has  long  been 
recognized  that  contracts  are  sometimes  awarded  to  firms  which  have  his¬ 
tories  of  poor  quality  products  or  late  deliveries.  It  has  been  hypoth¬ 
esized  that  the  recognized  problem  Is  largely  due  to  the  absence  of 
contractor  performance  history  systems  which  could  assist  decision  makers 
In  selecting  better  qualified  contractors.^ 

B.  BACKGROUND.  The  Idea  of  keeping  $/ historical  record  of  contractor 
performance  Is  not  new.  A  rather  complex  system,  the  Contractor  Perfor¬ 
mance  Evaluation  (CPEJPcogrami— was  established  In  1963  but  ultimately 
failed  due  to  t  hp^dafaoel  ng  difficult  to  understand,  cumbersome  to  use 
and  notrsu^f,1<^d«tly  current. 

C.  O&JECTIVt..  The  main  objective  of  this  effort  was  to  determine  the 

feasibility  of  developing  and  utilizing  a  AMC  Contractor  Performance 
History  System  as  a  possible  solution  to  the  problem  ,3*ated  ebe<^»  If 
such  a  system  were  deemed  feasible,  secondary  objective^/ were  to  provide  a 
system  framework  and  design***  prnp»e^ijaH»et*nir-fnr  system  Implemen¬ 
tation.  ■ - 

D.  SCOPE.  This  feasibility  study  was  to  be  based  upon  an  examination  of 
three  til  exl sting  quality-oriented  history  systems.  Additionally,  data 
available  ’from ■.-the  Defense  Contract  Administration  Services  (DCAS)  and 
data  compile?  by  the  Procurement  and  Production  Directorates  of  AMC's 
Major  Subordinate  Commands  (MSC's)  were  to  be  considered.^ 

E.  CONCLUSIONS  AND  RECOMMENDATIONS.  Establishing  a  contractor  performance 
hi  story  system  patterned  after  an  existing  Navy  quality  history  system  is 
feasible.  Implementation  Is  primarily  the  responsibility  of  the  AMC 
Quality  Assurance  and  Test  Directorate  which  is  currently  considering 
preliminary  actions.  While  establishment  oftljio^System  would  be  useful 
over  the  long  term,  the  current  sysierne^eimployed  by  DCAS  and  the  AMC 
MSC  Procurement  and  Productloru-Wrgctorates  meet  the  needs  of  the  Army 
Insofar  as  contract  awacds-^econcerned. 
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CHAPTER  I 


INTRODUCTION 

A.  PROBLEM. 

Within  the  field  of  defense  acquisition  It  has  long  been  recognised 
that  contracts  are  sometimes  awarded  to  firms  which  have  histories  of  late 
deliveries  and/or  poor  quality  products.  Placing  defense  contracts  with 
such  flrps  Is  not  only  bad  business  practice  but  also  a  violation  of  regula- 
tions  (DAR  1-900)  that  require  a  satisfactory  performance  record  as  a  pre¬ 
requisite  for  award  of  a  contract.  It  has  been  hypothesized  that  the 
recognized  problem  Is  largely  due  to  the  absence  of  contractor  performance 
history  systems  which  could  assist  decisionmakers  In  selecting  better  quali¬ 
fied  contractors. 

Unfortunately,  withholding  contract  awards  for  past  late  deliveries  and/or 
poor  quality  performance  Is  not  always  possible,  particularly  In  the  case  of 
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major  systems  contractors.  It  Is  for  this  reason  that  some  believe  a 
specialized  contractor  performance  history  system  for  major  Items  contractors 
Is  warranted.  It  Is  thought  that  such  a  system  could  lead  to  better  quality 
contractual  performance.  However,  major  Items  systems  will  not  be  addressed 
under  this  feasibility  study  which  centers  on  contractor  performance  history 
systems  for  secondary  Items/spare  parts.  A  follow-on  effort  concerned  with 
major  Items  will  be  initiated  If  deemed  appropriate. 

B.  BACKGROUND. 

The  Idea  of  keeping  a  historical  record  of  contractor  performance  Is  not 
new.  One  previous  attempt  was  the  Department  of  Defense  (DOD)  Contractor 
Performance  Evaluation  (CPE)  Program  established  In  1963.  About  eight 


years  later  the  program  was  cancelled  and  a  study  of  the  Army's  version  of 
CPE  was  performed.  That  study.  Army  Procurement  Research  Office  Report  201, 
An  Analysis  of  the  Army's  Contractor  Performance  Evaluation  Program,  January 

iV  •  r%\  ■ . 

1973,  found  that  the  CPE  data  had  been  difficult  to  understand,  cumbersome 
to  work  with  and  not  sufficiently  current.  The  study  concluded  that  while 
contractor  experience  data  Is  essential,  the  methods  to  gather  and  use  the 
data  must  be  straightforward,  easy  to  understand,  apply  and  administer,  and 
use  of  the  data  must  be  flexible.  It  further  concluded  that  the  data  must 
be  treated  as  a  management  tool  only,  not  a  decisionmaking  apparatus.  This 
may  be  the  proper  time  to  once  again  consider  the  Implementation  of  a 
contractor  performance  history  system,  but  the  lessons  of  the  past  must 
be  considered. 

Before  embarking  on  a  design  for  such  a  system,  certain  foundations 
must  be  built.  First,  to  develop  any  contractor  performance  history  system 
It  Is  necessary  to  create  measurement  tools  that  adequately  discriminate 
between  good  and  bad  performers.  A  measurement  tool  can  be  defined  as  a 
method  to  rate  an  individual  area  of  performance,  such  as  product  quality. 
Additionally,  specific  uses  of  system  data  must  be  determined  prior  to  system 
development.  Furthermore,  those  uses  must  be  deemed  reasonable  and  consistent 
with  the  legal  and  regulatory  requirements  placed  upon  D00  acquisitions. 
C.  OBJECTIVE. 

The  main  objective  of  this  effort  was  to  determine  the  feasibility  of 
developing  and  utilizing  a  AMC  Contractor  Performance  History  System  as  a 
possible  solution  to  the  problem  of  continuing  to  award  new  contracts  to 
those  firms  which  have  poor  performance  histories.  If  such  a  system  was 
deemed  feasible,  two  further  objectives  were  to  be  met.  The  first  of  these 


mss  to  provide  a  conceptual  framework  for  such  a  system.  The  second  was  to 
determine  which  organizations  should  be  responsible  for  refining  and  developing 
the  concept  Into  a  workable  system.  Any  resultant  system  was  to  be  oriented 
toward  secondary  Items/spare  parts. 

D.  SCOPE. 

After  reviewing  available  literature  It  was  determined  that  examinations 
of  existing  quality-oriented  history  systems  could  offer  the  greatest  Insights. 
The  Naval  Sea  System  Command  (NAVSEA)  has  been  experiencing  some  degree  of 
success  with  a  system  they  have  been  refining  during  the  past  eighteen  years. 
Additionally,  two  AMC  Subordinate  Commands  (AMCCOM  and  TSARCOM)  have  recently 
developed  their  own  systems. 

The  original  scope  of  this  effort  specifically  excluded  examination  of  the 
systems  employed  by  the  Defense  Contract  Administration  Services  (DCAS)  of 
the  Defense  Logistics  Agency  (DLA).  During  an  Interim  briefing  of  this  project, 
the  Director,  AMC  Procurement  and  Production  Directorate,  tasked  this  office 
to  Inquire  Into  the  nature  and  use  of  past  performance  data  collected  by  DCAS 
and  the  Procurement  and  Production  Directorate  of  AMC's  Major  Subordinate 
Commands  (MSC's). 

E.  ORGANIZATION. 

This  paper  Is  organized  Into  six  chapters.  Chapter  I  is  the  Introduction 
which  Includes  background  Information.  Chapter  II  discusses  potential  uses 
and  limitations  of  procurement  history  data.  Chapter  III  discusses  existing 
measurement  tools.  Chapter  IV  provides  an  overview  of  the  existing  quality- 
oriented  systems  referred  to  In  the  SCOPE  and  Chapter  V  presents  an  overview 
of  DCAS  and  AMC  MSC's  attempts  to  utilize  past  performance  data.  Chapter  VI 


presents  AP*0  conclusions  end  recommendations  and  actions  proposed  and  to  be 
performed  by  the  AMC  Quality  Assurance  and  Test  Directorate. 


CHAPTER  II 

PERFORMANCE  HISTORY  USES  AND  LIMITATIONS 

A.  SYSTEM  USE. 

Analysis  has  shown  that  In  the  contract  award  process  practical  Govern¬ 
ment  use  of  contractor  performance  history  data  Is  possible  in  three  ways. 

o  Withhold  contract  awards  from  poor  performers  per  DAR  1-900.  (See 

B.  below.) 

o  Award  with  caution  if  a  contract  must  be  placed  with  a  firm  known 
to  have  a  history  of  problems.  Additional  surveillance  or  other  controls 
could  be  placed  on  those  contracts. 

o  Award  without  concern  to  those  firms  with  good  performance  his¬ 
tories.  Surveillance  could  be  limited  on  those  contracts. 

As  discussed  In  Chapter  I,  It  is  necessary  to  determine  the  purpose(s) 
for  which  a  system  will  be  used  before  the  system  Is  designed.  The  purpose 
of  any  system  which  may  be  put  Into  use  should  be  to  Identify  poor  perform¬ 
ing  contractors  In  order  to  withhold  awards  or  award  with  caution.  In  this 
manner  the  system  can  aid  in  minimizing  contractor  performance  problems. 
8.  RESPONSIBILITY  DETERMINATION. 

It  was  noted  above  that  one  use  of  a  performance  history  system  is  to 
withhold  contract  awards  from  poor  performers.  Since  DOD  acquisitions  are 
highly  regulated,  it  Is  necessary  to  discuss  the  only  widely  applicable 
mechanism  by  which  a  contract  award  can  be  withheld  from  a  poor  performer  who 
otherwise  would  be  the  successful  bidder/offeror.  This  mechanism  Is  termed 
the  responsibility  determination  and  detail  can  be  found  in  DAR  1-900. 
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OAR  1-900  sets  minimum  standards  a  contractor  must  attain  to  be  deemed 
responsible  and  therefore  eligible  for  award  of  a  defense  contract.  Some  of 
those  standards  concern  past  performance.  One  standard  requires  that  a  con¬ 
tractor  have  a  satisfactory  performance  record,  including  quality.  DAR  1-900 
provides  further  guidance  on  aspects  one  must  consider  for  a  contractor's 
record  to  be  deemed  satisfactory: 

o  The  contractor  must  not  deliver  items  with  quality  defects  of  a 
critical  or  repetitive  nature  without  taking  corrective  action. 

o  The  contractor  must  not  be  seriously  deficient  in  current  con¬ 
tract  performance. 

o  The  contractor  must  not  have  past  unsatisfactory  performance  due 
to  failure  to  apply  necessary  tenacity  and  perseverance. 

If  a  contractor  does  not  meet  the  above  criteria  he  is  determined  to  be 
non-responsible  and  cannot  receive  a  contract  award.  In  this  manner  the 
Government  is  prohibited  from  awarding  a  contract  to  a  proven  poor  performer 
unless  the  firm  Is  a  small  business.  In  that  case  the  Small  Business  Admin¬ 
istration  (SBA)  retains  the  right  to  issue  a  Certificate  of  Competency  (COC) 
and  thereby  overturn  a  contracting  officer's  non-responsibility  determination. 
However,  just  as  there  should  be  a  reasonable  basis  for  making  a  non-respons¬ 
ibility  determination,  SBA  should  have  a  reasonable  basis  for  Issuing  a  COC. 
C.  QUALITY  HISTORY  PROGRAM. 

As  noted  above,  there  Is  legal  machinery  by  which  defense  contracts  can 
be  denied  to  firms  with  records  of  poor  performance.  If  a  centralized  his¬ 
torical  performance  file  existed,  it  would  seem  quite  simple  to  exclude  those 
firms  with  poor  performance  histories  from  receiving  new  contracts.  However, 


currently  there  is  not  a  historical  performance  file  that  identifies  poor 
performers.  This  results  in  identification  and  exclusion  of  poor  performers 
in  a  random  rather  than  consistent  manner. 

DOD  Directive  4155.1,  Quality  Program,  was  issued  10  Aug  78  and  it 
established  certain  DOD  policies  and  assigned  responsibilities.  Among  those 
responsibilities  was  the  requirement  that  DOD  components  maintain  quality  his¬ 
tory  data  to  attack  the  problem  cited  in  Section  1  of  this  report.  Under 
paragraph  4.  of  C.  POLICY  AND  OBJECTIVES,  the  Directive  states, 

"4.  DOD  Components  shall  assure  that  contracts  are  not 
awarded  to  contractors  with  a  previous  history  of  providing 
products  or  services  of  an  unsatisfactory  quality.  Contractor 
quality  history  data  shall  be  maintained  and  used  for  this 
purpose." 

It  Is  understood  that  all  AMC  QA  elements  are  complying  with  the 
historical  data  requirements.  AMCCOM  and  TSARCOM  use  automated  files,  while 
the  other  AMC  MSC's  maintain  historical  data  manually.  If  the  QA  elements 
used  the  data  they  collect  to  identify  the  poorer  performers,  then  it  might  be 
possible  to  "assure  that  contracts  are  not  awarded  to  contractors  with  a  pre¬ 
vious  history  of  providing  products  or  services  of  an  unsatisfactory  quality." 
However,  there  are  no  active  programs  which  identify  poor  performers  and  deny 
them  new  contracts. 


CHAPTER  III 
MEASUREMENT  CRITERIA 


INTRODUCTION. 

As  noted  in  Chapter  I,  the  use  of  measurement  tools  that  adequately 
scrlminate  between  satisfactory  and  unsatisfactory  performance  is  necessary 
poor  performing  contractors  are  to  be  identified.  The  first  step  in 
:amining  measurement  tools  is  to  identify  those  areas  of  performance  that 
in  be  objectively  measured.  Subjective,  non-contractual  areas  of  measure- 
;nt,  such  as  attitude  and  degree  of  cooperation,  will  be  excluded.  If  two 
jntractors  can  both  deliver  identical  items  in  the  same  amount  of  time 
nder  the  same  Government  surveillance  conditions,  legal  conditions  dictate 
hat  they  must  be  considered  equal  in  terms  of  relative  performance.  Also, 
ompl lance  with  non-performance  related  requirements  such  as  Cost  Accounting 
tandards  and  EEO  provisions  are  to  be  excluded  since,  for  performance  measure- 
ent,  our  concern  lies  only  with  actual  performance  factors.  Based  upon  the 
bove,  only  two  areas  of  performance  lend  themselves  to  objective  measurement: 
uality  of  product  and  timeliness  of  delivery.  Quality  can  be  objectively 
easured  by  conformance  to  specifications.  Timeliness  can  be  measured  by 
dherence  to  delivery  schedules. 

.  QUALITY. 

Measuring  quality,  or  conformance  to  specifications,  can  be  done  prior 
o  Government  acceptance  or  after  Government  acceptance.  If  an  item  is  shown 
ot  to  conform  before  acceptance,  it  should  not  be  accepted.  A  contractor's 
dherence  to  in-process  quality  requirements  such  as  MIL-Q-9858A,  Quality 
rogram  Requirements,  and  MIL-I-45208A,  Inspection  System  Requirements,  can 
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1. c.  below.  Operational  details  of  that  program  at  the  Baltimore  DCASMA  are 
then  presented. 

1.  Types  of  Data. 

a.  Production  Schedule  Completion  Report  (PSCR). 

(1)  This  is  a  DCAS-wide  report  of  completed  contracts.  Each 
DCASMA  has  its  own  report  which  covers  the  contracts  over  which  that  DCASMA 
has  cognizance.  These  ADP  reports,  which  are  printed  monthly,  are  retained 
for  one  year.  For  each  completed  contract,  the  PSCR  shows  the  following 
data: 

(a)  Scheduled  delivery  date 

(b)  Actual  delivery  date 

(c)  If  late,  length  of  delinquency  is  stratified 

(d)  If  late,  reason  for  delay 

(e)  If  late,  responsibility  for  delay  (Government,  Contractor, 

Undetermined) 

(2)  If  a  delivery  date  has  been  extended,  the  PSCR  shows  that 
an  extension  had  been  made,  however,  the  extended  delivery  date  replaces  the 
original  date  and  the  reason  for  the  extension  is  not  reported. 

(3)  As  an  example,  the  PSCR  can  readily  show  that  a  particular 
contractor  completed  two  contracts  during  the  past  year.  Of  those,  one  con¬ 
tract  was  completed  on  schedule  and  the  other  was  60  days  late  due  to  the 
Government  furnishing  defective  GFM.  Reasons  for  delays  and  placement  of 
responsibility  are  based  upon  the  perceptions  of  the  DCASMA  Industrial 
Specialist. 

b.  Individual  Contract  Abstract. 

As  noted  above  the  PSCR  only  shows  data  on  completed  contracts. 


CHAPTER  V 


PERFORMANCE  RECORDS  BASED  UPON  DCAS  DATA 

A.  INTRODUCTION. 

As  stated  in  Chapter  I,  paragraph  D.  Scope,  the  Director,  AMC  Procure¬ 
ment  and  Production  Directorate,  tasked  APRO  to  inquire  into  the  nature  and 
uses  of  past  performance  data  collected  by  DCAS  and  the  Procurement  and 
Production  Directorates  of  the  AMC  MSC's.  Coordination  with  DCAS  Head¬ 
quarters  at  Cameron  Station  resulted  in  a  field  visit  to  the  Baltimore 
Defense  Contract  Administration  Services  Management  Area  (DCASMA)  office. 
Information  on  DCAS  operations  was  obtained  through  personal  interviews  and 
data  examination.  Relevant  information  on  the  MSC's  collection  and  use  of 
past  performance  data  was  obtained  through  telephone  discussions  with  cog¬ 
nizant  personnel  at  AMCCOM,  CECOM,  MICOM,  TACOM  and  TSARCOM. 

B.  DCAS. 

Before  discussing  the  nature  and  uses  of  past  performance  data  within 
DCAS  it  must  be  recognized  that  there  are  nine  (9)  distinct  DCAS  Regional 
(DCASR)  offices.  Each  DCASR  is  responsible  for  a  number  of  DCASMA's.  DCASR's 
report  to  HQ  DCAS  at  Cameron  Station.  Not  all  DCASR's  operate  identically. 
Likewise,  there  may  be  differences  in  the  methods  used  by  different  DCASMA's 
responsible  to  the  same  DCASR.  Nonetheless,  it  is  believed  that  the  methods 
used  to  gather  data  and  the  formats  in  which  the  data  are  reported  are  common 
to  all  DCASMA's  even  though  the  uses  of  the  data  may  vary  somewhat  from 
DCASR  to  DCASR  and  DCASMA  to  DCASMA.  In  the  narrative  that  follows,  data 
uses  (as  concerns  Pre-Award  Surveys)  should  be  common  to  all  DCASMA's.  An 
overview  of  the  DCAS  Contractor  Improvement  Program  (CIP)  is  presented  in 

21 


200-300  of  the  poorest  performers  during  the  past  six  month  period.  Through 
a  series  of  meetings  and  discussions,  with  participation  from  representatives 
from  the  purchasing  activities,  the  final  VDAR  is  reduced  to  50  firms  through 
comparative  analysis  techniques.  This  becomes  the  semi-annual  VOAR.  In 
between  the  publishing  of  the  VDAR's,  bulletins  sometimes  are  Issued  to  add 
or  delete  a  vendor. 

For  sole  source  producers  or  for  contracts  awarded  In  spite  of  known 
problems,  contractually  mandatory,  tailored  Inspection  clauses  are  aimed  at 
the  perceived  problem  area.  The  PCO  tasks  QA  to  develop  these  clauses. 
Additionally  DCAS  may  be  tasked  to  put  100%  Inspection  effort  Into  a  speci¬ 
fied  problem  area.  The  manager  of  this  system  perceives  that.  In  general, 
contractors  wish  to  avoid  being  placed  on  the  VDAR  and  will  normally  take 
reasonable  action  to  Improve  their  performance. 

C.  SUMMARY. 

The  main  difference  between  the  quality  measurement  tools  available  to 
NAVSEA  and  AHC  Is  that  NAVSEA  can  use  reject  rates  from  receipt  Inspection 
records  because  some  critical  Items  are  re-inspected  before  going  Into  stock. 
Also,  where  a  contractor  has  a  poor  performance  history  and  items  are  to  be 
delivered  to  the  fleet,  DCAS  may  Inspect  at  source  but  accept  at  destination. 
The  NAVSEA  quality  history  system  can  be  adapted  to  AMC  needs.  However, 
due  to  a  lack  of  depot  receipt  inspections,  a  AMC  system  may  not  be  as 
easy  to  use  as  NAVSEA's  (when  distinguishing  between  good  and  poor  producers). 
A  system  using  a  comparative  analysis  method  Is  practicable. 
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data  from  the  system  managers,  NMQAO  and/or  their  local  representatives.  The 
data  file  on  that  contractor  must  be  given  consideration  before  an  award  Is 
made.  The  VDAR  is  not  a  "go/no  go"  list;  it  merely  requires  that  the  PCO 
consider  available  data  in  his  responsibility  determination.  The  vendors  are 
aware  of  the  VDAR  and  the  Chief,  NMQAO  believes  that  some  are  motivated  to 
upgrade  their  efforts  to  either  be  removed  from  the  VDAR  or  to  avoid  being 
Included  In  the  VDAR  In  the  first  place. 

There  are  presently  about  6000  contractors  in  the  NAVSEA  system. 
Currently,  the  system  Is  mainly  confined  to  a  couple  of  hundred  items  con¬ 
sidered  critical.  When  an  award  is  made  for  a  critical  item,  the  purchasing 
activity  forwards  a  copy  of  that  contract  to  NMQAO  for  entry  Into  the  system. 
Contracts  for  non-crltlcal  items  are  not  put  into  the  system  when  an  award  is 
made.  However,  If  quality  problems  are  later  reported,  that  Information  Is 
entered. 

Every  6  months  a  VDAR  Is  developed  and  disseminated  to  the  purchasing 
activities.  Poor  performance  alone  will  not  get  a  vendor  placed  on  the  VDAR. 
When  quality  problems  occur,  the  responsible  firms  are  notified  and  are  asked 
to  respond  by  stating  the  corrective  action  they  intend  to  take.  The  data 
system  documents  contractor  responses.  If  problems  prove  to  be  repetitious 
or  if  promises  are  not  met,  NMQAO  notifies  contractors  that  they  are  sus¬ 
pected  of  being  poor  performers.  Contractors  are  given  an  opportunity  to 
respond  to  QAO.  Once  a  contractor  has  been  put  on  notice  by  NMQAO  and 
falls  to  overcome  the  stated  problem(s)  he  becomes  a  candidate  for  the  VDAR. 

Presently,  a  vendor  with  2  or  more  uncorrected  problems  In  the  past 
6  months  Is  placed  on  a  preliminary  VOAR.  NAVSEA  recognizes  the  crude  nature 
of  existing  measuring  tools  and  uses  the  best  data  available  to  determine 
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In  existence  (although  changing)  for  more  than  18  years.  Unlike  the  other 
systems  which  have  the  primary  function  of  aiding  in  resource  management, 
the  NAVSEA  system's  primary  function  Is  to  collect  data  and  Identify  contrac¬ 
tors  with  continuing  quality  problems.  The  main  benefit  perceived  by  the 
managers  of  the  system  is  that  aspect  of  the  system  which  motivates  an  Iden¬ 
tified  poor  producer  to  Increase  his  quality  of  performance.  Unlike  the 
TSARCOM  and  AMCCOM  systems  which  are  oriented  toward  better  contract  manage¬ 
ment  in  the  quality  functional  area,  the  NAVSEA  system  attempts  to  manage 
and  affect  the  quality  of  performance  of  contractors  by  motivating  them  to 
Improve  through  an  Implied  threat  of  punishment. 

As  discussed  in  Chapter  III,  there  are  only  three  practical  uses  of 
contractor  performance  history  data.  The  one  use  that  could  truly  motivate 
a  contractor  would  be  the  threat  (and  subsequent  action,  if  necessary)  of 
withholding  contract  awards  If  that  contractor  had  a  continuing  history  of 
poor  performance.  This  Is  the  motivational  method  that  the  NAVSEA  system 
employs. 

The  NAVSEA  system  Is  operated  by  the  NAVSEA  Material  Quality  Assess¬ 
ment  Office  (NMQAO)  located  at  Portsmouth,  NH.*  The  NMQAO  collects  data 
from  50-60  naval  activities  (shipyards,  weapons  stations,  etc.)  and  then 
evaluates  the  data  to  Identify  vendors  with  continuing  quality  problems. 
Semi-annually  those  vendors  are  Included  on  a  list  of  poor  performers  which 
Is  called  the  Vendor  Data  Analysis  Report  (VDAR).  The  VDAR  is  distributed 
to  NAVSEA  purchasing  activities.  If  an  award  Is  contemplated  to  a  contractor 
on  the  VDAR,  the  Purchasing  Contracting  Officer  (PCO)  must  request  historical 

*  All  the  Information  describing  this  system  was  provided  through  interviews 
with  the  Chief,  NMQAO. 
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the  system  has  been  operational  for  only  a  short  time,  it  provides  a  foun¬ 
dation  for  a  comparative  analysis  system  to  identify  problem  producers  at 
TSARCOM. 

2.  AMCCOM  System. 

AMCCOM  also  uses  a  quality-oriented  automated  history  system  that  was 
derived  from  the  TSARCOM  system.  Implemented  in  January  1983  there  has  been 
backloading  of  some  information  from  contracts  awarded  as  early  as  1979.  As 
with  the  TSARCOM  system,  this  system  is  perceived  mainly  as  a  management  aid 
for  placement  of  QA  resources.  The  developer  of  the  system  stated  that, 
based  upon  historical  Information  In  the  system,  managers  can  be  alerted  as 
to  which  contractors  need  additional  Government  surveillance.  The  developer 
believes  that  prior  to  system  Implementation,  managers  reacted  to  problems 
too  late.  Now  some  problems  can  be  anticipated.  Since  this  system  was 
derived  from  the  TSARCOM  system,  the  data  elements  that  would  allow  a  com¬ 
parative  analysis  of  contractors  are  present.  All  AMCCOM  contracts  and 
purchase  orders  are  entered  into  this  system.  There  are  presently  about 
10,000  open  contracts. 

Attempts  have  been  made  to  numerically  rate  contractors  but,  due  to 
the  cited  problems  with  measurement  tools  and  some  "system  bugs,"  the  only 
purpose  this  rating  serves  is  to  give  management  a  crude  Indicator  of  pos¬ 
sible  poor  performance.  A  low  rating  does  not  necessarily  mean  poor  perfor¬ 
mance  and  a  more  thorough  analysis  of  narratives  must  be  done.  As  with  the 
TSARCOM  system,  the  foundation  of  a  comparative  analysis  system  exists  If 
enough  historical  data  were  available. 

3.  NAVSEA  System. 

The  NAVSEA  system,  also  a  quality -oriented  automated  system,  has  been 


17 


were  entered  into  the  system.  The  main  purpose  of  the  system  Is  to  aid 
TSARCOH  QA  management  In  resource  allocation.  A  developer  of  the  system 
explained  that  the  main  perceived  benefit  was  providing  data  that  noted 
scheduled  QA  actions  (plant  visits,  pre-award  surveys,  etc.)  which  allowed 
the  management  of  travel  (TDY)  to  be  performed  more  efficiently. 

Only  contracts  for  critical  Items  (Items  that  could  threaten  life  If 
they  failed)  are  put  Into  the  system.  There  are  presently  about  2300  con¬ 
tracts  entered  Into  the  system.  The  system  Is  designed  In  such  a  way  that 
It  can  accommodate  detailed  narratives  for  a  large  number  of  data  elements. 
Some  data  elements  In  the  TSARCOH  system  are: 

Preaward  Narratives 
First  Article  Test  Results 
Request  for  Deviation 
Request  for  Waiver 
Test  Narratives 
Rework  Quantities 
Variations  from  TDP 
Trip  Reports 
QOR  data 
GFM  data 

While  the  TSARCOH  system  In  its  present  configuration  has  little 
value  as  a  contract  performance  measurement  tool.  It  could  be  altered  to  be 
of  greater  value.  If  the  system  were  used  to  identify  problem  producers 
through  a  comparative  analysis  of  contractors,  the  more  historical  contract 
data  available  the  more  dependable  the  results  of  any  analysis.  Although 


CHAPTER  IV 


SELECTEO  QUALITY  HISTORY  SYSTEMS 


A.  INTRODUCTION. 

One  aspect  of  determining  the  feasibility  of  a  performance  history  system 
was  to  examine  existing  measurement  tools  to  understand  the  degree  of  accu- 
racy  achievable.  Additionally,  It  was  necessary  to  examine  existing  systems 
that  performed  some  historical  recordkeeping  and/or  rating  functions.  Three 
systems  were  examined.  Two  of  the  systems  were  Army  systems  and  both  those 
systems  appeared  to  have  been  designed  to  aid  in  managing  existing  contracts 
from  the  perspective  of  Quality  Assurance  (QA)  personnel.  The  third  system, 
operated  by  a  Navy  purchasing  command  not  only  aids  QA  personnel  In  managing 
existing  contracts,  but  also  attempts  to  Identify  poorly  performing  contrac¬ 
tors.  Most  of  the  data  for  the  systems  Is  derived  from  actions  In  which 
local  QA  personnel  participate.  These  are  primarily  quality  systems  and  are 
Independent  of  other  functional  areas  and  the  Defense  Logistics  Agency. 
Time  did  not  permit  a  detailed  examination  of  Air  Force  efforts  but  discus¬ 
sions  with  a  representative  of  the  Office  of  the  Assistant  to  the  Commander 
for  Quality  at  the  Air  Force  Logistics  Command  revealed  that  certain  tech¬ 
niques  similar  In  concept  to  those  of  the  Navy  system  (described  later)  were 
being  used.  A  description  of  the  highlights  of  the  three  systems  examined 
follows. 

B.  SYSTEMS. 

1.  TSARCOM  System. 

This  quality -oriented  automated  history  system  was  Implemented  in 
January  1982.  It  required  approximately  12  months  for  the  system  to  gather 
enough  contract  data  to  be  useful  since  few  contracts  awarded  prior  to  1982 
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period  can  lead  to  a  waiver  of  the  delivery  schedule  which  would  then  result 
In  the  Government  losing  Its  right  to  terminate  for  default.  Likewise, 
repetitive  schedule  extensions  can  prevent  the  Government  from  using  late 
deliveries  as  an  administrative  means  of  evaluating  popr  performance. 

4.  Effects  on  Delivery  Data. 

Policy  and  legal  considerations  affect  the  usefulness  (as  a  measure¬ 
ment  tool)  of  the  delivery  data  put  Into  CCSS.  Unless  It  Is  possible  to 
redesign  the  base,  the  accuracy  of  the  data  will  remain  highly  questionable 
since  many  deliveries  that  are  truly  late  will  be  considered  on  time. 
D.  SUMMARY. 

The  systems  that  appear  to  measure  quality  and  delivery  were  developed 
for  purposes  other  than  keeping  historical  performance  records  on  defense 
contractors.  As  they  are  presently  structured,  the  QDR  system  and  the  CCSS 
delivery  Information  system  cannot  be  depended  upon  to  provide  accurate 
performance  measurement  data. 
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Logistics  Agency  (DLA)  utilizes  delinquency  rates  as  one  of  the  tools  by 
which  they  measure  their  managers.  Delinquencies  can  be  viewed  as  either 
management  problems  or  system  problems.  Many  methods  to  lower  delinquency 
rates  exist. 

These  methods  include: 

o  better  surveillance  over  contractors 
o  more  realistic  delivery  schedules 

o  extensions  of  the  delivery  schedules  to  remove  the  delinquen¬ 
cies  and  make  the  contracts  current. 

An  extension  of  the  delivery  schedule  (usually  for  some  form  of  con¬ 
sideration)  is  the  easiest  and  most  common  approach  to  remove  a  delinquency. 
However,  this  approach  obliterates  the  originally  established  delivery  date 
and  thereby  reduces  the  validity  of  the  data  for  historical  recordkeeping 
purposes.  As  currently  structured,  the  delivery  data  In  CCSS  cannot  be  used 
as  a  delivery  compliance  measurement  tool. 

3.  Legal  Considerations. 

On  the  Issue  of  delivery  schedules  the  law  Is  rather  complex.  Gener¬ 
ally,  If  the  Government  allows  a  contractor  to  miss  a  scheduled  delivery  date 
and  takes  no  action  within  a  reasonable  period  of  time,  the  Government  has 
effectively  waived  the  delivery  schedule  and  loses  its  right  to  terminate  for 
default.  In  order  to  retain  its  right  to  terminate  for  default  the  Govern¬ 
ment  must  either  establish  a  new  delivery  date  or  issue  a  forbearance  noti¬ 
fication.  Forbearance  essentially  means  that  during  a  Government  decision 
making  period,  the  contract  will  not  be  terminated  nor  will  the  delivery 
schedule  be  revised.  Due  to  legal  complexities,  a  prolonged  forbearance 
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current.  If  a  delivery  date  has  passed  and  Items  have  not  been  delivered, 
the  the  contract  Is  delinquent.  Information  In  the  system  Is  retained  for 
twentyfour  (24)  months  after  the  last  hardware  delivery. 

If  a  scheduled  delivery  date  Is  changed,  the  data  can  be  misleading 
in  terms  of  measuring  adherence  to  delivery  schedules.  Reasons  for  revising 
delivery  dates  will  be  explained  later.  However,  for  now.  It  Is  sufficient 
to  note  that  It  Is  not  uncommon  for  delivery  schedules  to  be  renegotiated. 
While  some  schedule  changes  are  fully  justified,  other  adjustments  are  made 
for  administrative  reasons.  The  manner  In  which  CCSS  deals  with  changes 
requires  the  revised  delivery  date  to  replace  the  originally  established 
delivery  date.  This  means  that  the  system  no  longer  recognizes  the  original 
delivery  date.  A  delinquent  contract  would  then  become  current  and  any 
record  of  the  delinquency  would  be  abolished.  It  must  be  noted  that  this 
system  was  not  designed  to  keep  historical  delivery  records  but  to  monitor 
deliveries. 

Historical  records  that  accurately  reflect  the  originally  scheduled 
delivery  date  and  the  actual  delivery  date  could  be  extracted  from  CCSS 
If  delivery  dates  were  never  changed.  However,  valid  changes  In  performance 
requirements  and  certain  current  policy  and  legal  considerations  may  require 
that  delivery  schedules  sometimes  be  revised.  Changes  In  delivery  schedules 
due  to  policy  and  legal  considerations  will  be  discussed  In  the  following 
paragraphs. 

2.  Policy  Considerations. 

Managing  delinquency  rates  (measured  by  dividing  the  number  of  total 
open  contracts  by  the  number  of  delinquent  contracts)  is  a  concern  of  both 
purchasing  and  administrative  offices.  It  has  been  observed  that  the  Defense 
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The  QOR  system  suits  the  purpose  for  which  It  was  designed,  but  It  does 
not  accurately  measure  quality  of  performance.  The  present  structure  of  the 
QOR  system  does  not  allow  distinctions  to  be  made  between  the  following 
conditions. 

Poor  quality  In  critical  Item 

Item  does  not  conform  to 
specifications 

Item  must  be  replaced 

Contractor  uncooperative 

Entire  contract  quantity  poor 

C.  DELIVERY. 

1.  Background. 

Attempting  to  differentiate  between  good  and  bad  producers  on  the 
basis  of  product  quality  alone  may  not  adequately  reflect  a  contractor's 
overall  performance.  It  Is  necessary  to  consider  a  contractor's  history 
of  meeting  scheduled  deliveries.  A  high  quality  product  delivered  one  year 
late  can  sometimes  prove  to  be  less  valuable  than  a  fair  quality  product 
delivered  on  time. 

Contract  delivery  data  Is  retained  in  the  Commodity  Command  Standard 
System  (CCSS)  files.  On  the  surface,  the  workings  of  the  system  appear  to  be 
quite  simple.  Once  a  contract  Is  awarded,  the  established  delivery  date  and 
contract  Identification  data  (contractor,  NSN,  quantity,  etc.)  are  entered 
Into  CCSS.  CCSS  periodically  produces  varied  reports  concerning  deliveries; 
however,  all  the  reports  show  contracts  In  either  a  current  or  delinquent 
delivery  status.  If  the  delivery  date  has  not  yet  arrived,  a  contract  Is 


Poor  quality  In  non-critical  item 
Item  conforms  to  bad  specifications 

Item  can  be  reworked 

Contractor  reworks /replaces  at  no 
cost 

Problem  with  small  percentage 


A)  were  discovered  co  be  defective  by  each  of  the  five  different  users  and, 
therefore,  resulted  in  the  submission  of  five  QDR's.  If  contractor  quality 
ratings  were  based  on  the  number  of  QDR's,  the  condition  given  in  the  above 
example,  e.g.,  one  contractor  -  five  defective  items,  could  result  in  Con¬ 
tractor  B  having  five  QOR's  and  Contractor  A  having  one. 

Since  the  QDR  system  was  developed  for  reasons  other  than  measuring  the 
quality  of  a  contractor's  performance.  It  is  not  and  cannot  become  an  accu¬ 
rate  measurement  tool.  Even  If  the  inequities  caused  by  simply  counting  the 
number  of  QOR's  were  resolved  It  would  be  necessary  to  categorize  deficien¬ 
cies  according  to  Importance.  Presently,  the  QDR  system  identifies  deficien¬ 
cies  as  Category  I  and  II,  hut  for  accurate  performance  measurement  purposes 
the  necessary  distinctions  are  not  truly  made.  Category  I  deficiencies  can 
cause  death.  Injury,  serious  damage  to  weapons  systems  or  impair  readiness. 
All  other  deficiencies  are  Category  II.  If  using  the  QDR  system  to  measure 
performance  history,  a  deficiency  in  an  inexpensive  piece  of  machined  metal 
would  have  an  equal  weight  to  a  deficiency  in  a  very  expensive  complex  piece 
of  electronics  although  both  may  be  considered  Category  II  deficiencies 
under  the  QDR  system.  Another  problem  inherent  to  using  the  QDR  system  as 
an  accurate  measurement  of  performance  is  the  notion  of  responsibility  for 
the  defective  Item.  If  an  Item  doesn't  work  a  QDR  is  filed;  and  even  if  it 
Is  later  discovered  that  the  defect  was  due  to  poor  Government  specifications, 
the  contractor  is  still  charged,  per  the  data  system,  with  a  QDR.  When  this 
study  began,  the  QDR  system  did  not  note  responsibility  for  defects,  but 
AMC  QA  representatives  stated  that  responsibility  data  would  soon  be  included 
In  the  system. 


also  be  used  as  means  of  measurement.  For  purposes  of  this  report,  attention 
Is  focused  on  the  quality  of  accepted  goods  and  the  systems  that  measure  that 
quality. 

To  accurately  measure  a  contractor's  performance  In  terms  of  product  qual¬ 
ity  a  system  must,  as  a  minimum,  perform  the  following  functions: 

o  Identify  percentage  of  defective  material  in  relation  to  quantity 
delivered. 

o  Place  responsibility  if  possible 
o  Rate  the  cost  In  both  direct  and  indirect  terms 
o  Rate  the  criticality  of  the  defect 
o  Assess  any  corrective  action  taken  by  contractor 

Without  a  system  that  considers  these  features,  a  contractor's  performance 
cannot  be  adequately  measured.  A  method  currently  used  by  AMC  Quality 
Assurance  to  measure  the  quality  of  a  firm's  performance  Is  to  total  the  num¬ 
ber  of  Quality  Deficiency  Reports  (QDR’s)  attributable  to  that  firm.  QDR's, 
as  the  name  Implies,  are  reports  on  items  that  appear  (normally  to  a  field 
user)  to  be  defective.  The  purpose  of  the  QDR  system  is  to  identify  defec¬ 
tive  material  and  take  corrective  action.  Actions  could  include  removing 
the  material  from  Government  stocks,  attempting  to  get  a  contractor  to  rework/ 
replace  defective  items,  or  possibly  revising  inaccurate  Government  specifi¬ 
cations. 

A  QDR  is  normally  filed  by  a  field  user.  If  an  item  does  not  work  pro¬ 
perly  or  does  not  fit  properly  a  QDR  should  be  submitted.  One  user  may 
discover  five  defective  items  from  Contractor  A  and  submit  one  QDR  citing 
those  five  items.  Also,  under  the  QDR  system,  it  is  possible  that  five 
items  furnished  by  Contractor  B  (identical  to  those  furnished  by  Contractor 


I  he  Individual  Contract  Abstract  shows  the  delivery  status  of  current  con¬ 
tracts.  These  AOP  products  are  generated  either  when  there  is  any  change  or 
activity  on  the  contract  (e.g.,  modifications,  deliveries)  or  when  specifi¬ 
cally  requested.  The  Individual  Contract  Abstract  data  is  monitored  and 
Input  by  the  Industrial  Specialist  (IS).  Therefore,  the  IS  is  in  a  position 
to  report  on  the  current  delivery  status  of  any  contract  (contractor)  for 
which  he  is  responsible.  When  all  deliveries  are  complete  and  the  contract 
is  closed  out,  the  data  on  the  Individual  Contract  Abstract  is  input  to  the 
PSCR. 

2.  Uses  of  Data. 

a.  Formal  Pre-Award  Survey. 

Within  the  context  of  this  project's  concern  with  contractor  past 
performance  histories,  this  data  is  primarily  used  by  the  DCASMA  Pre-Award 
Monitor.  He  needs  all  that  Information  when  responding  to  buying  offices' 
informal  and  formal  requests  for  Pre-Award  Surveys  (PAS).  An  Informal  re¬ 
quest  would  normally  be  a  telephone  call  inquiring  about  the  contractor.  In 
response  to  such  a  call  the  Pre-Award  Monitor  performs  the  following  (if  the 
contractor  has  any  history  with  DCAS): 

(1)  The  PSCR  is  reviewed  and  the  requestor  is  notified  of  the 
contractor's  delivery  history  Including  delinquencies  and  reasons  for  them. 

(2)  If  the  PSCR  data  indicates  further  Inquiry  is  necessary,  the 
Pre-Award  Monitor  contacts  the  responsible  Industrial  Specialist  for  a  report 
on  the  status  of  current  contracts. 

(3)  Past  surveys  are  reviewed  and  relevant  information  is  relayed 


to  the  requestor. 


(4)  A  review  of  the  problem  contractors  participating  in  the 
Contractor  Improvement  Program  (CIP)  is  conducted.  An  overview  of  the  CIP 
can  be  found  in  c.  below  and  operating  details  of  the  Baltimore,  OCASMA  CIP 
are  listed  in  3.  below. 

b.  Informal  Pre-Award  Survey. 

If  the  data  reviewed  indicates  a  potential  for  problems,  the  Pre- 
Award  Monitor  will  suggest  to  the  buying  office  that  a  formal  PAS  be  per¬ 
formed.  Also,  if  a  contractor  Is  In  the  Cl?,  a  formal  PAS  will  be  suggested. 
If,  however,  the  data  Indicates  little  potential  for  problems,  the  buying 
office  can  use  the  Information  gained  In  the  Informal  PAS  to  make  an  affir¬ 
mative  responsibility  determination. 

A  formal  PAS  may  result  In  an  unsatisfactory  rating  in  the  "Per¬ 
formance  Record"  section  of  the  Survey.  One  such  PAS  observed  presented 
statistical  data  that  Indicated  a  high  delinquency  rate.  That  PAS  stated 
that  the  contractor  had  not  successfully  taken  corrective  action.  The  Per¬ 
formance  Record  section  concluded, 

"Analysis  and  evaluation  of  the  offeror's  performance 
shows  an  unacceptably  high  rate  of  delinquency.  There¬ 
fore,  this  factor  Is  rated  unsatisfactory.  Offeror 
Is  presently  monitored  under  the  Contractor  Improvement 
Program." 

At  the  conclusion  of  the  Production  Part  of  the  PAS,  DCASMA  stated 
"...no  award  Is  recommended." 

c.  Contractor  Improvement  Program  (CIP). 

(1)  The  OCAS  CIP  Is  essentially  an  Internal  OCAS  program  that 
identifies  problem  contractors  (only  those  over  which  OCAS  has  cognizance). 


Through  a  DCAS  team  approach.  Internal  contractor  operating  systems  (e.g. 
quality,  purchasing,  etc.)  are  examined  In  an  attempt  to  Identify  and  correct 
problems.  The  CIP  Is  not  publicized  nor  are  lists  of  problem  contractors 
published.  The  CIP  allows  DCAS  to  manage  their  resources  more  efficiently  by 
putting  emphasis  on  the  contractor  rather  than  on  Individual  contracts.  In 
order  for  a  contractor  to  be  entered  into  the  CIP  a  history  of  problems  must 
exist.  To  be  released  from  the  program  an  improvement  trend  must  be  noted. 
It  Is  believed  that  each  DCASMA  runs  Its  own  CIP. 

(2)  The  information  presented  in  paragraph  c.  above  is  applicable 
to  the  CIP  implemented  by  all  DCASMA's.  Specifics  of  the  program  as  run  by 
DCASMA  Baltimore  follow.  However,  It  must  be  remembered  that  these  specifics 
may  or  may  not  apply  to  the  CIP  as  implemented  by  other  DCASMA's. 

(3)  DCASMA  Baltimore  CIP. 

(a)  Before  a  contractor  goes  into  the  CIP  run  by  the  Balti¬ 
more  DCASMA,  the  IS  who  normally  performs  routine  surveillance  begins  to  get 
a  "feel"  that  the  contractor  In  question  may  be  having  problems.  The  IS 
then  performs  more  Intensive  surveillance  while  Informally  reporting  to  his 
Branch  Chief.  If  problems  continue,  the  contractor  is  considered  for  entry 
Into  the  CIP. 

(b)  Because  It  is  widely  believed  that  delinquencies  are 
indicators  of  problems,  this  DCASMA  uses  a  guideline  of  a  25%  delinquency 
rate  for  contractors  to  determine  entry  Into  their  CIP.  The  25%  rate  Is 
only  a  guideline  and  It  Is  flexible. 

(c)  When  a  contractor  is  formally  entered  Into  the  CIP  It 
becomes  the  concern  of  the  Industrial  Specialist's  Branch  Chief.  The  CEO  of 


the  company  Is  notified  as  are  buying  activities  that  have  contracts  with  the 
contractor.  When  Informal  requests  for  PAS  are  received  it  is  recommended 
that  a  full  PAS  be  performed  before  making  any  additional  awards  to  CIP 
contractors.  The  IS  performs  physical  surveillance  on  a  biweekly  basis. 
Monthly  reviews  of  CIP  contractors'  progress  are  held  with  the  DCASMA  Com¬ 
mander. 

(d)  If  after  three  months  the  CIP  contractor  does  not  show 
an  improvement,  concern  for  that  contractor  Is  elevated  from  the  Branch 
Chief  to  Division  Chief.  The  DCASMA  Division  Chief  then  visits  the  plant  to 
hold  discussions  with  his  counterpart,  often  a  vice  president  of  the  company. 
Biweekly  surveillance  by  the  IS  continues. 

(e)  If,  after  three  months  at  Division  level  the  problem 
still  persists.  It  Is  elevated  to  the  local  commander  for  a  meeting  with  his 
direct  counterpart  in  the  company,  usually  the  president  or  CEO.  As  yet  It 
has  not  been  necessary  to  elevate  problems  any  further  than  the  local  com¬ 
mander. 

(f)  The  Baltimore  DCASMA  releases  a  contractor  from  CIP  when 
he  shows  an  Improvement  trend.  Some  contractors  have  been  In  this  program 
continuously  since  its  Inception  In  1981. 

C.  DARCOM  MSC  PROCUREMENT  DIRECTORATES. 

1.  AMCCOM. 

AMCCOM  has  no  formal  or  informal  systems  other  than  data  kept  by  Indi¬ 
vidual  buyers  primarily  for  their  personal  use.  Buyers  coordinate  directly 
with  DCASMA  when  Inquiring  about  the  necessity  for  a  PAS. 

2.  CECOM. 

CECOM  has  a  small  unit  In  the  Procurement  Directorate  that  serves 


•s  a  coordinator  between  the  PCO  and  DCAS  for  PAS's.  They  maintain  past 
PAS's.  A  review  of  past  PAS's  and  a  telephone  call  to  the  DCASMA  Pre-Award 
Monitor  (Informal  PAS)  result  In  a  recommendation  to  the  PCO  which  suggests 
a  formal  PAS  be  either  waived  or  required. 

Additionally,  contractor  delivery  performance  records  are  main¬ 
tained  on  critical  Items.  These  records  are  used  to  identify  problem  pro¬ 
ducers  or  problem  Items  for  either  more  extensive  surveillance  and/or  award 
process  consideration. 

3.  MICOM. 

MICOM  utilizes  a  Pre-Award  Manager  whose  main  function,  as  relates 
to  past  performance.  Is  to  analyze  available  data  and  recommend  (to  the  PCO) 
whether  a  formal  PAS  be  waived  or  required. 

The  data  consulted  primarily  consists  of  past  PAS's.  Additionally, 
DCAS  generated  notifications  of  problem  contractors  are  reviewed.  Also, 
Quality  Deficiency  Report  (QDR)  data  Is  examined  and  If  problems  are  Indi¬ 
cated,  the  Pre-Award  Manager  consults  with  cognizant  MICOM  Quality  Assurance 
personnel  for  further  Input. 

4.  TACOM. 

TACOM  maintains  and  uses  two  sets  of  historical  data.  One  set  Is  a 
history  of  the  Item  for  the  purposes  of  gathering  Information  on  production 


problems  and  for  gauging  production  lead  times. 

The  other  set  of  historical  data  Is  the  quarterly  Issued  list  of 
Contractors  Requiring  Special  Attention.  This  list  Is  based  upon  delinquen¬ 
cies  for  the  previous  six  months,  QOR's  and  any  special  problems.  For  pur¬ 
poses  of  the  list,  delinquencies  are  based  upon  the  originally  scheduled 
delivery  date  unless  a  delay  was  due  to  the  fault  of  the  Government. 
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Buyers  are  furnished  this  list  with  the  recommendation  they  not  soli¬ 
cit  contractors  for  small  purchases  (under  $25,000).  For  larger  purchases 
it  Is  recommended  that  award  be  withheld  from  large  businesses,  and  it  is 
recommended  that  a  formal  PAS  be  performed  before  any  contract  award  to 
small  businesses.  Most  of  the  data  is  drawn  from  various  Commodity  Command 
Standard  System  (CCSS)  Production  Reports.  Also  close  TACOM  coordination 
with  selected  OCASMA's  add  to  the  available  data. 

5.  TSARCOM. 

TSARCOM  uses  a  Monthly  Delinquency  Report  to  Identify  problem  con¬ 
tractors.  The  report  is  strictly  based  on  delinquencies.  Past  performance 
must  be  considered  and  formal  PAS's  are  required  before  award  of  new  con¬ 
tracts  to  firms  listed  on  the  Monthly  Delinquency  Report.  If  deemed  neces¬ 
sary,  coordination  with  DCAS  is  affected  to  attempt  corrective  action. 
D.  SUMMARY. 

The  data  provided  by  DCAS  Pre-Award  Surveys  appear  to  satisfy  AMC's 
needs  for  contractor  past  performance  history  Insofar  as  determining  whether 
a  prospective  contractor  can  be  deemed  responsible.  If  a  firm's  past  perfor¬ 
mance  records  indicate  a  history  of  problems,  those  records  can  be  used  to 
support  a  non-responsibility  determination.  Even  though  record  keeping 
methods  that  exist  .at  AMC  MSC's  are  used  mainly  as  screening  devices  to 
determine  the  necessity  of  a  PAS,  that  data  can  also  be  used  to  supplement 
PAS  data.  Potential  use  of  the  historical  data  is  not  confined  to  responsl- 
oility  determinations  alone.  As  Indicated  under  SYSTEM  USE  in  Chapter  II, 
the  data  may  highlight  the  need  for  additional  government  surveillance  or 
other  contractual  controls  when  a  contract  is  of  necessity  awarded  to  a  firm 


with  a  history  of  performance  problems.  This  usage  Is  submitted  to  be  of 
equal  Importance  to  responsibility  determinations. 


CHAPTER  VI 


CONCLUSIONS  AND  RECOMMENDATIONS 


A.  CONCLUSIONS. 

1.  Feasibility  of  Establishing  a  Contractor  Performance  History  System. 

The  research  revealed  that  a  AMC  Contractor  Performance  History 

System  Is  feasible  if  it  Is  patterned  after  the  NAVSEA  system.  The  responsl- 
blllty  for  Implementation  properly  rests  with  the  AMC  Quality  Assurance 
and  Test  Directorate.  Implementation  will  require  refinement  of  the  quality 
data  systems  maintained  by  the  QA  elements  at  AMC  MSC's.  As  the  report 
pointed  out,  the  current  MSC  QA  systems  are  designed  for  internal  QA  manage¬ 
ment  and  not  for  keeping  records  on  contractors  for  the  purpose  of  determin¬ 
ing  suitability  for  future  awards.  By  refining  the  MSC  QA  systems  through 
adapting  the  NAVSEA  system,  it  will  be  possible  to  identify  historically 
poor  producers  using  comparative  analysis  methods.  Then  a  Vendor  Data  Analy¬ 
sis  Report  (VDAR)  type  list  can  be  provided  to  contracting  elements  to  use 
as  a  tool  In  selecting  the  best  qualified  contractors. 

2.  DCAS  and  AMC  MSC  Procurement  Directorates. 

While  the  VDAR  type  system  would  be  useful  over  the  long  term,  the 
current  systems  employed  by  DCAS  and  the  MSC  Procurement  Directorates  do 
provide  data  to  contracting  officials  that  can  be  used  in  making  supportable 
responsibility  determinations.  From  a  contract  award  perspective,  the  perfor¬ 
mance  history  data  currently  available  meets  the  needs  of  the  Army.  The 
Information  In  Chapter  V  Indicates  that  If,  In  fact,  contract  awards  are 
being  made  to  firms  which  have  histories  of  late  deliveries  and/or  poor  qual¬ 
ity  products.  It  Is  not  necessarily  due  to  an  absence  of  adequate  historical 
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data.  It  could  be  due  to  other  reasons;  such  as  non-use  of  the  data,  single 
sources  of  supply  or  regulatory  requirements  that  impede  Independent  DOD 
decision  making.  Finally,  it  must  be  recognized  that  this  information  can 
also  be  used  to  determine  the  degree  of  surveillance  necessary  during  con¬ 
tract  performance. 

B.  PENDING  ACTIONS. 

Partial  findings  of  this  research  (excluding  Chapter  V  material)  were 
presented  to  the  Director  of  the  AMC  Quality  Assurance  and  Test  Director¬ 
ate  and  his  staff  during  an  in-process  review  held  30  September  1983.  The 
Director  accepted  the  conclusion  that  AMC  adaptation  of  the  NAVSEA  system 
is  feasible  and  also  acknowledged  that  system  development  was  properly  the 
responsibility  of  Quality  Assurance.  As  a  result  of  the  in-process  review, 
the  Director  Is  considering  the  following  actions: 

o  Revising  the  AMC  Depot  Performance  System  to  be  more  In  line  with 
the  NAVSEA  receipt  inspection  system.  In  support  of  their  Intended  action, 
the  following  Information  was  provided  by  the  AMC  Quality  Assurance  and 
Test  Directorate: 

"...Because  there  are  basic  concept  similarities  between  the  Depot 
Performance  System  and  the  information  on  receipt  inspection  which  is  accom¬ 
plished  by  NAVSEA,  it  is  possible  that  the  Depot  System  could  be  expanded  and 
collected  from  all  depots  Into  a  central  Data  Bank  to  be  used  to  develop  a 
quality  history  system.  It  Is  also  possible  that  a  system  could  be  developed 
using  the  type  of  Information  gathered  by  TSARCOM/AMCCOM  using  a  comparative 
analysis  method." 

o  Revising  the  TSARCOM  and  AMCCOM  contractor  performance  history  system 
to  place  attention  on  poor  quality  producers  and  to  allocate  Internal  QA  re¬ 
sources  more  effectively. 

C.  RECOMMENDATIONS. 

The  findings  of  this  research  do  not  suggest  a  need  for  any  further 
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actions  at  this  time  other  than  those  under  consideration  by  the  AMC  Qual¬ 
ity  Assurance  and  Test  Directorate.  Revisions  of  the  AMC  Depot  Perfor¬ 
mance  System  and  the  contractor  quality  history  systems  currently  In  use  at 
AMCCOM  and  TSARCOM  should  allow  comparative  analysis  methods  to  be  used  to 
Identify  poor  producers  from  a  quality  perspective.  At  that  time  coordin¬ 
ation  with  AMC  contracting  elements  should  be  effected  and  development  of 
VDAR  type  lists  could  begin.  Then  the  detailed  quality  history  data  should 
be  combined  with  the  DCAS  information  bases  to  aid  In  responsibility  deter¬ 
minations. 
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